Class-Similarity Based Label Smoothing for Confidence Calibration

نویسندگان

چکیده

Generating confidence calibrated outputs is of utmost importance for the applications deep neural networks in safety-critical decision-making systems. The output a network probability distribution where scores are estimated confidences input belonging to corresponding classes, and hence they represent complete estimate likelihood relative all classes. In this paper, we propose novel form label smoothing improve calibration. Since different classes intrinsic similarities, more similar should result closer values final output. This motivates development new smooth based on similarities with reference class. We adopt similarity measurements, including those that capture feature-based or semantic similarity. demonstrate through extensive experiments, various datasets architectures, our approach consistently outperforms state-of-the-art calibration techniques uniform smoothing.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Memory-Based Learning: Using Similarity for Smoothing

This paper analyses the relation between the use of similarity in Memory-Based Learning and the notion of backed-off smoothing in statistical language modeling. We show that the two approaches are closely related, and we argue that feature weighting methods in the Memory-Based paradigm can offer the advantage of automatically specifying a suitable domainspecific hierarchy between most specific ...

متن کامل

Memory-Based Learning: Using Similarity for Smoothing

This paper analyses the relation between the use of similarity in Memory-Based Learning and the notion of backed-off smoothing in statistical language modeling. We show that the two approaches are closely related, and we argue that feature weighting methods in the Memory-Based paradigm can offer the advantage of automatically specifying a suitable domainspecific hierarchy between most specific ...

متن کامل

Manifold-based Similarity Adaptation for Label Propagation

Label propagation is one of the state-of-the-art methods for semi-supervised learning, which estimates labels by propagating label information through a graph. Label propagation assumes that data points (nodes) connected in a graph should have similar labels. Consequently, the label estimation heavily depends on edge weights in a graph which represent similarity of each node pair. We propose a ...

متن کامل

Similarity-based Multi-label Learning

Multi-label classification is an important learning problemwith many applications. In this work, we propose a principled similarity-based approach for multi-label learning called SML. We also introduce a similarity-based approach for predicting the label set size. The experimental results demonstrate the effectiveness of SML for multi-label classification where it is shown to compare favorably ...

متن کامل

Class label versus sample label-based CCA

When correlating the samples with the corresponding class labels, canonical correlation analysis (CCA) can be used for supervised feature extraction and subsequent classification. Intuitively, different encoding modes for class label can result in different classification performances. However, actually, when the samples in each class share a common class label as in usual cases, a unified form...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Lecture Notes in Computer Science

سال: 2021

ISSN: ['1611-3349', '0302-9743']

DOI: https://doi.org/10.1007/978-3-030-86380-7_16